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The D0 experiment at Fermilab's Tevatron will record several petabytes of data over 
the next five years in pursuing the goals of understanding nature and searching for the 
origin of mass. Computing resources required to analyze these data far exceed capabilities 
of any one institution. Moreover, the widely scattered geographical distribution of D0 
collaborators poses further serious difficulties for optimal use of human and computing 
resources. These difficulties will exacerbate in future high energy physics experiments, like 
the LHC. The computing grid has long been recognized as a solution to these problems. 
This technology is being made a more immediate reality to end users in D0 by developing 
a grid in the D0 Southern Analysis Region (D0SAR), D0SAR-Crid, using all available 
resources within it and a home-grown local task manager, McFarm. We will present 
the architecture in which the D0SAR-Crid is implemented, the use of technology and 
the functionality of the grid, and the experience from operating the grid in simulation, 
reprocessing and data analyses for a currently running HEP experiment. 



1. Introduction 

Particle physicists employ high energy particle accelerators and complex detectors 
to probe ever smaller distance scales in an attempt to understand the nature and 
origin of the universe. The Tevatron proton-anti proton collider located in the De- 
partment of Energy's Fermi National Accelerator Laboratory^ Batavia, Illinois, 
currently operates at the " energy frontier" and has an opportunity of providing new 
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2 D0SAR 

discoveries through the D021 and GDI™ high energy physics (HEP) experiments. 
Future experiments, such as 

ATLAfl 

at the Large Hadron Collider (lhc; 5 in the 
European Organization for Nuclear Research (CERNjSl and a proposed electron- 
positron linear collider (LCJ^ have the prospects of either building on discoveries 
made at Fermilab, or making the discoveries themselves if nature has placed these 
new processes beyond the energy reach of the Tevatron. 

2. D0SAR 

As part of the D0 experiment's effort to utilize grid technology for the expeditious 
analysis of data, twelve universities have formed a regional virtual organization 
(VO), the D0 Southern Analysis Region (D0SAR)0The centerpiece of D0SAR is a 
data and resource hub called a Regional Analysis Center (RAC) ^constructed at the 
University of Texas at Arlington with the support of NSF MRI funds. Each D0SAR 
member institution constructs an Institutional Analysis Center (IAC), which acts as 
a gateway to other RACs and to the grid for the users within that institution. These 
IACs combine dedicated rack-mounted servers and personal desktop computers into 
a local physics analysis cluster. The data access system for D0 offline analyses is 
managed by a database and cataloging system called Sequential Data Access via 
Metadata, or SAM.H^The MC_Runjob package^! provides a low- level MC manager 
that coordinates data files used by and produced with the executables of the MC 
chain, via scripts produced for the job. This package is combined with MC task 
management software called McFarrrl^, developed at UTA, for automated, highly 
efficient MC production. 

3. D0SAR-Grid 

In order to pursue full utilization of grid concepts, we are establishing an oper- 
ational regional grid called D0SAR-Grid using all available resources, including 
personal desktop computers and large dedicated computer clusters. We have con- 
structed and are operating D0SAR-Grid utilizing a framework called SAM-GricP^ 
being developed at Fermilab. D0SAR-Grid will subsequen tly b e made interopera- 
ble under other grid frameworks such as LCGp^ TeraGridp^ Grid3p^ and Open 
Science GridP^ Wherever possible, we will exploit existing software and technolog- 
ical advances made by these other grid projects. We plan to develop and implement 
tools to support easy and efficient user access to the grid and to ensure its robust- 
ness. Tools to transfer binary executables and libraries efficiently across the grid 
for environment-independent execution will be developed. D0SAR will implement 
the Grid for critical physics data analyses, while at the same time subjecting grid 
computing concepts to a stress test to its true conceptual level, down to personal 
desktop computers. Many of the proponents of this project are members of the LHC 
ATLA£@1 experiment an d a future experiment under study by the American Linear 
Collider Physics Group, ^ and will apply the experience gained from D0SAR to 
these projects. 
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4. Conclusions 

Experimental particle physics has always pushed information technology in direc- 
tions that have had profound broader impact, with the most spectacular example 
being CERN's development of the World Wide Web, originally intended to fa- 
cilitate communication among collaborating physicists spread around the globe. 
D0SAR's goal of efficiently using computing resources scattered across the south- 
central United States for tasks such as complex data reduction and simulation will 
produce grid computing solutions with broad applicability. This project will also 
likely affect how we disseminate and analyze data from future experiments at fa- 
cilities such as the LHC. D0SAR will help improve the cyber-infrastructure within 
the region; five participating institutions are located in states that are traditionally 
under- funded for R&D activities. In addition to technology development, there will 
also be significant development of human resources in the region, delivering inter- 
disciplinary training in physics and computer science. Information for the broader 
public will be disseminated on the web. Finally, D0SAR will realize the conceptual 
grid to the level of personal desktop computers, demonstrating the performance of 
a grid at its fullest level. The D0SAR Grid will be exploited in critical physics 
analyses of real and simulated data from the D0 experiment, and later from LHC 
and other future experiments. These data will serve to advance our understanding 
of nature at the smallest distance scales. 
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